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In two earlier papers, two of the present authors (A.G. and U.S.) extended Lai's [Ann. Probab. 1 
(1974) 432-440] law of the single logarithm for delayed sums to a multiindex setting in which 
the edges of the nth window grow like |n| a , or with different a's, where the a's belong to (0, 1). 
In this paper, the edge of the nth window typically grows like n/logn, thus at a higher rate 
than any power less than one, but not quite at the LIL-rate. 
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1. Introduction 

Let X, {Xk, k > 1} be i.i.d. random variables with mean and partial sums {S n , n > 1}. 
The Hartman-Wintner law of the iterated logarithm (LIL) states that 

g 

limsup(liminf) =n "(~ fT ) a - s - 

n->oo n^ao -y/271 log log n 

^> EX 2 <oo, EX = and EX 2 = a 2 . 

The sufficiency was proven by Hartman and Wintncr [8], the necessity by Strassen [11]. 

The law of the single logarithm (LSL) is due to Lai [9], and deals with delayed sums 
or windows, namely, with 

n+k 

T n>n+ k= ^ Xj, n>0,k>l, 

j=n+l 

and states that for < a < 1, 



limsup ==gyl-a a.s. 

rwoo \J2n a \ogn 
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E{\X\ 2/a (\og + \X\)- 1/a ) <oo, EX 2 = a 2 , EX = 0, 

where, throughout, log + x = maxjlogx, 1}. 

The degenerate boundary case a = contains the trivial one, in that the window 
reduces to a single random variable. More precisely, in that case, 

T, y < - ) ° 

'0 asn->oo > P(|X| > &„) < oo, 



n—l 

which, in turn, holds if and only if Eb~ 1 (\X\) < oo, where b" 1 ^) is a (suitably defined) 
inverse of {b n }. 

The next interesting case with a = is when the span a„ = logn, that is, the window 
T n , n +\ogn, in which case the so-called Erdos-Renyi law ([3], Theorem 2, [2], Theorem 
2.4.3) tells us that if EX = and the moment generating function ipx{t) = E exp{tX} 
exists in a ncigborhood of 0, then for any c > 0, 

n . ^fc.fc+clog k / \ 

lim max — — r 2 — = p(c) a.s., 

n-s-oo 0<k<n-k clOgfc 

where 

p(c)=sup{x:infe- t:E Vx(<) >c~ 1/c }. 

Note that here the limit actually depends on the distribution of the summands. 

For a generalization to more general window widths a n such that a„/log7i — > oo as 
n— > oo, but still assuming that the moment generating function exists, see, for example, 
[2], Theorem 3.1.1, where the limit, in contrast to the result just cited, does not depend on 
the distribution. Results where the moment condition is somewhat weaker than existence 
of a moment generating function were discussed in [10]; here, the limit depends on both 
the variance and the distribution. Using strong invariance principles Lai's result above 
can be generalized somewhat, see, for example, [2], Theorem 3.2.1, but there at least the 
pth moment, p > 2, is needed. 

For the boundary case at the other end with a = 1, one has a n = n and T n _i n = S n , 
and the correct norming is as in the LIL. 

One interesting remaining case is when the window size is larger than any power less 
than one and, at the same time, not quite linear. This is the starting point of the present 
paper. Technically, we wish to examine windows of the form 

n 

r„, n +a„, where a„ = —- (1.1) 

L(n) 

with 

xL'(x) 

a diffcrcntiable function L(-) /■ oo <G SV and \ as x — > oo. (1.2) 

L(x) 

Notation. L e SV means that L is slowly varying at infinity (see, for example, [1] or 
[5], Section A. 7). 
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The typical case one should have in mind is L(n) = logn, that is, the window 

-^n,n+n/ logn- 

Remark 1.1. Strictly speaking, we should write a n = [n/L(n)\, a„ = [n/ logn] and so on. 
However, in order to avoid trivial and boring technicalities, we shall treat such sequences 
as integer- valued whenever convenient. 

In Section 2 we present the setup, the main result and the implications for some 
typical slowly varying functions, namely L(x) = (logx) p for p > and iterated logarithms 
L(x) = log m a;, where log m (x) denotes the m-times iterated logarithm. For the proof, in 
Section 3, we first review the exponential inequalities. Section 3.2 then introduces a 
family of subsequences within which sufficiency of the moment condition is proved in 
Sections 3.3-3.6. Section 3.7 deals with the same issue for the full sequence, while the 
question of necessity is dealt with in Section 3.8. Proofs of the corollaries in Section 2 are 
provided in Section 4, while Section 5 furnishes further examples, including some with 
more complicated slowly varying parts. 

It turns out that the proof of the main result has some ingredients in common with 
that of the classical LIL, primarily in the sense that one needs two truncations, one to 
match the Kolmogorov exponential bounds and one to match the moment requirements. 
Typically (and somewhat frustratingly) , it is the thin central part that causes the main 
trouble in the proof. A weaker result is obtained if only the first truncation is made. The 
cost is that too much integrability will be required. However, for the reader who is not so 
concerned with optimality, we include a proof of this weaker version in Section 6, after 
which we revisit two examples in order to illustrate the consequences. 

2. Setup and main result 

Recall that the window widths, assumed to be of the form n/L(n), where the 

function L satisfies (1.2). Define {d n ,n> 2} by 

TL 

d n = log h log log n = log L(n) + log log n. 

a n 

Note that {d n } may be viewed as the additional norming sequence in Theorem 2.1, in 
the sense that it corresponds to {log 2 n} in the LIL and {logn} in the LSL. 
Furthermore, let 

f(n) =min{a n • d n ,n}, 

with /(•) an increasing interpolating function, that is, f(x) = /r x i for x > and / _1 (-)j 
the corresponding (suitably defined) inverse function. 
Here, now, is our main result. 
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Theorem 2.1. Suppose that X, X\,Xi, . . . are i.i.d. random variables with mean and 
finite variance a 1 , and let T„. n+ fe = X)J=n+i -^j- V 



then 



Conversely, if 



E(f-\X'))<oo, (2.1) 



lim sup "'" + °" = q- a . s . (2.2) 

n— yco y*2a n d n 



f I lim sup — -f=- < 00 I 

\ n— >oo v a n d n ) 



>0, (2.3) 



i/iera (g.lj holds, EX = Q and (2.2) holds with a 2 =VarX. 

Remark 2.1. The "natural" necessary moment assumption is (2.1) with f(n) = a n d n . 
However, for very slowly increasing functions L, for example, L(x) — log log log log x, 
it turns out that finite variance is needed, and since we then have f(n) = n, (2.1) is 
equivalent to finite variance. 

Remark 2.2. The result also holds for any sequence {a„} which is of regular variation 
of order a € (0,1). Here, the sufficiency part can be obtained from strong invariance 
principles, as described in, for example, Theorem 3.2.2 in the book [2]. However, for our 
situation, no strong invariance principle is available. 

Remark 2.3. In addition to the lim sup results, there exist, throughout, liminf counter- 
parts such that lim inf • • • = — lim sup ■ ■ • a.s. Actually, the set of limit points is the whole 
interval [—a, a]. 

The slowly varying function that immediately comes to mind is (of course) the log- 
arithmic function. The second one would be L(x) = log 2 x = log log x and, possibly, 
L(x) = log m (a;). We precede the proofs by stating the conclusions for these cases as 
separate corollaries. For simplicity, we omit the converse parts. 

Corollary 2.1. Suppose that X,X\,X2, . . . are i.i.d. random variables with mean and 
finite variance a 1 , and let T n , n+ k = Y^= n +i ^j- If, for some p > 0, 

Ex'Qfwr (2 . 4) 

Iok+Iok+LY V 



then 



1- -*Tl,»+n/(logn)* in r\ 

hm sup = = a a.s. (2.5) 



n— >oo 



yj2 {p + 1 ) (n / (log n)P ) log log n 
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Corollary 2.2. Suppose that X,Xi,X2, ■ ■ ■ are i.i.d. random variables with mean and 
let T n _ n+ k = Y^j= n +l ■ V a2 = ^ ar X < 00 > i/ien /or any m > 2, 

limsup =cr a.s. (2.6) 

™^oo v /2(n/log m (n))loglogn 

Note that in the case m = 2, the normalization is just y/2n. Proofs of the corollaries 
are deferred to Section 4 and further examples are given in Section 5. 

3. Proof of Theorem 2.1 

In spite of the fact that we are dealing with limit laws for delayed sums, the present 
topic is, in fact, too close to the LIL to warrant LSL techniques. In contrast to the proofs 
in [9] and [6, 7], where one uses exponential bounds and BorcLCantelli lemmas for the 
single primed contribution along a suitably subsequence, and takes care of the double 
and triple primed contributions for the full sequence and fills the gaps, we have to resort 
to the LIL technique where one proves Borel— Cantelli lemmas and thus also the theorem 
itself, first for subsequences and then for the entire sequence. 

We thus begin by providing Borel-Cantelli sums along subsequences, after which an 
appeal to the Borel-Cantelli lemmas completes the proof for subsequences. 

Section 3.7 is devoted to the problem of "filling the gaps" in order to include arbitrary 
windows. 

3.1. Truncation and exponential bounds 

The typical approach to proving results of the LIL type requires two truncations: the 
first to match the Kolmogorov exponential bounds (see, for example, [5], Section 8.2) 
and the second to match the moment requirements. 

To this end, we introduce parameters 6 > and e > 0, and let 




and 

X' n = X n I{\X n \ < b n }, K = X n I{b n < \X n \ < Syff(n)}, 
XZ' = X n I{\X n \>5^J(n)}. 

In the following, all objects with primes or multiple primes refer to the respective trun- 
cated summands. 
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Since truncation destroys centering, we obtain, using standard procedures, together 
with the fact that EX = 0, 

\EX' k \ = \-EX k I{\X k \ > b k }\ < E\X\I{\X k \ > b k ] < EX2j i\ j K \ > b ^ 

Ok 

so that 

-2 rri rKfc.l T?V2, 



r™* EX 2 I{\X\>b k } EX 2 I{\X\>b n } 

\ ET n,n+a n I < 2^ T < 7 



n<k<n+a n 



Upper bounds 
Since 

it follows that 



■ \Ja n d n - EX 2 I{\X\ > b n } = o(V 'a n d n ) 

ad 



V&rX' k < E(X' k f < EX 2 = a 2 , 



(3.2) 



as n — > oo . 



Var(T; n+a J<a n( T 2 . (3.3) 

An application of the Kolmogorov upper exponential bound (see, for example, [5], Lemma 
8.2.1) with x = e(l — 5)y/2d n and c n = 28/x, together with (3.2) and (3.3), now yields 



P(K, n +a n > ^2a n d n ) < P(K n+an - ET^ n+an > s(l - 5)^2a n d n ) 

e(l-8) 



— P\ ^n,n+o n P''P'n,n+a n > 



^ v /2Var(r; liIl+a jd„) 



(3.4) 

_ 2e 2 (l-S) 2 dn(i §) 



exp 



2a 2 
e 2 (l-<5) 3 



Lower bounds 

In order to apply the lower exponential bound (see, for example, [5], Lemma 8.2.2), we 
first need a lower bound for the truncated variances: 

Var = EX' k 2 - (EX' k ) 2 = EX 2 - EX 2 I{\X k \ > b k } - (EX' k ) 2 
>a 2 - 2EX 2 I{\X k \ > b k } > a 2 (l - 5) 

for n large, so that 

Var(T' J > a n a 2 (l - S) for n large. (3.5) 
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It now follows that for any 7 > 0, 



P(Kn+a n > eV2a n d n ) > P{T' n>n+an - ET^ n+an > e{\ + 5)^2a n d n ) 

e(l + S) 



> P\T' n ,n +an - ET>^ n+an > J^—!- ^2V ar (T^ n+a Jd n ^ 

' (3-6) 

f 2e 2 (l+<5) 2 , , 
3.2. A family of subsequences 

In order to choose a suitable subsequence, consider the difference equation rik+i — n^ — 
crife / L(rik) with a suitable constant c > to be determined later, or, in continuous vari- 
ables, 

y' = cy/L(y). (3.7) 

With (p(y) = j v L ^ d " being in the class II (see [1] for the notation and Theorem 3.7.3) 
and ij){x) — ifi" 1 (x) being in the class V (see [1] for the notation and Theorem 3.10.4), 
the solution of the differential equation is given by ib(cx) and the subsequence of interest 
is rik = ip(ck). Note that = 1 + — > 1 and that L(iik+\) / L(rik) — > 1 as k — > 00. 
An important relation in the following is 

d Uk = log(L(tp(ck)) logV'(cfc)) ~ log(cfc) ~ log k as t — > 00 for any c > 0, (3.8) 

which is an immediate consequence of the following result. 

Lemma 3.1. With a slowly varying function L(-) satisfying (1.2), we have 

log(L(i) log*) 



log^(t) 



1 as t^ 00. (3.9) 



Proof. With ip*(t) = L(t)\ogt, we have <p(t) < (p*(t) since L(-) /-. Next, 

/"V // s L (u)\ r* l'(u)ul(u) ri 

<p*(t)= \L (u)logu-\ — )du = / \ , V ; / -dvdu + (p(t) 

Ji V u J Ji L{u)u J 1 v 

< f— [ U ^ldvdu + ^t)<v(t)(l + \og(L(t))) 7 
Ji u J 1 L(v) 



where we used condition (1.2). Hence, 

logy (t) > 1 log 
log^*(t) - log(L(t)logt) 



log^ log(l + logL(f)) 
1>t rr > 1 ; ; — r-r - : ; > 1 as I- >■ 00. U 
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Remark 3.1. In the classical proof of the LIL, the subsequence has a geometric growth 
rate: {X k ,k > 1} for some A close to 1. For the LSL, the subsequence has a polynomial 
growth rate: {(k/ log fc) 1 ^ 1- "), k > 1}. It is therefore natural in the present, intermediate, 
context to search for a subsequence with a growth rate between geometric and polynomial, 
that is, to search for something like {\ kf> ,k > 1} for some /3 <E (0, 1). For the canonical 
case L(n) = \ogn, it turns out that ~ e c ^2k _ 

3.3. Sufficiency along subsequences: T' n n+a 

The upper bound 

Here, we use c > small. Let {n^ = ip(ck), k > 1}, where /* oo as k — > oo, satisfy 

e 2 (l-5) 3 



OO f 

E ex py 

k=l 



T 2 



d nk }<oo. (3.10) 



Applying (3.4) to {X' k , k > 1} then yields 

OO 

Y,P{\T'n k ,n k+ a nk \>e^2a~aV k )<^ (3.11) 



fe=i 



for any e > a. Note that (3.11) is independent of the special choice of c > 0. 
The lower bound 

We now choose the sparser subsequence {n^ = tp(ck), k > 1}, where c > 1 and n& /* oo 
as k — > oo , satisfying 

|^_f0_^).^}_ (3 , 2) 

for any s < a. Observe that the windows are now non-overlapping since c > 1 implies 
that Uk+i > Uk + nk/L(nk) eventually Applying (3.6) to this sequence similarly shows 
that 

oo 

E P ( T L« fc +a„ fc >e y /2a nh d n „)=< X >. (3.13) 
fc=i 

3.4. Sufficiency along subsequences: T^ n+an 

The next step is to prove the analog of (3.11) for T£ n+a , that is, 

oo 

J2 P (\ T n.n+aJ>S^/7H)<^- (3-14) 

fc=l 
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The symmetric case 

We first consider symmetric random variables, beginning by recalling the Kahane- 
Hoffmann-j0rgensen inequality (see, for example, [5], Theorem 3.7.5). 

Lemma 3.2. Suppose that Xi,X2, ■ ■ ■ ,X n are independent symmetric random variables 
with partial sums S n , n>l. 

(i) For any x, y > 0, 

P(\S n \ >2x + y)<p( max \X k \ > y) + 4(P(|5 n | > x)f 

\l<k<n J 

n 

<J2P(\Xk\>v)+^P(\S n \>x)f. 

k=l 

(ii) If X\, X%, . . . , X n are identically distributed (and x = y), then an iteration yields 
that there are constants m > 0, i = 1,2, such that 

P{\S n \ > 9X) < KmPQXtl >X)+ K 2 (P(\S n \ > X))\ 

Applying the lemma to T" n+a , we thus obtain, with r\ = (5/9 , that 



P(\K n+a J>6Vftnj) 

n-\-a n 

< Kl Pim>v^)) + ^{P{\Tl n+a ^> v ^WT))f (3.15) 

k=n+l 

< K ian P(\X\ > r/V/W) + K2(P(Kn+a n \ > V^/lH)f- 

Summing over our subsequence for ko large (remembering that d„ k ~ logfc as k — > oo), 
we now have 



J2 a nk P(\X\> V ^J^)) 



k—ko 

oo 



< £ a nh P(f^\X*/ V 2 ) > n k ) = £ J*ptf-i)(X*/r?) > n k ) 

k—ko k—ko 

ip(x — 1) . , . . dx , ^(y) 

— -7— r — > c> 0, a change of variable y = wlx), hence, — = w (y) = 

ip(x) dy y 

y Ptf (-r) {X 2 /v 2 )>cy) m dy= r P(f (-i) {X 2 /r] 2 )>cy)dy 



L{y) y 
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<CEf(-^(X 2 ) <oc, 

which takes care of the first term in the right-hand side of (3.15). 
As for the second one, Chebyshev's inequality tells us that 



p(\r'\>vVf(n)) < 2 ;;T" < 



VarT^„ +an a n EX 2 I{b n < \X\ < 6y/f(n + n/L(n))} 



i] 2 f(n) rff{n) 



e EX 2 I{b n < \X\ < 6,Jf(n + n/L(n))} e EX 2 
<j8 ~ aS r] 2 d n 

and, hence, that 

(P(\K n+a J > r/VTR)) 4 < ^-£^{EX 2 fEX 2 I{b n < \X\ < 6^f(n + n/L(n))} 



so that 



a -r) jEX*f E P (\ T Ln k+ n k/Li n k) \ > V^JW)) (3-17) 



k—k(\ 



EX 2 I{b nk < \X k \<Sy/f(n k + n k /L(n k ))} 

k = k 



00 1 r*V ' f(n k +n k /L(n k )) 



k—k{ 



(3.18) 



where fc* is some irrelevant lower limit and 



A(k, x) = {k: b 1lk < \x\ < 6tJ f(n k + n k /L(n k ))}. 

In order to invert the double inequality, we first observe that in the case f(n) = a n d n 
(the case f(n) = n is simpler and only the necessary changes are indicated), 

n k + n k /L(n k ) n k / 1 

S+ " k/I( " k) " L(n k + n k /L(n k )) ~ L(n k ) + L(n k ) 

and that 

d nk +n k /L(n k ) = log L(n k +n k /L(nk)) +loglog(n fe +n k /L(n k )) ~ logd„ fc ~ logfc ~ \og(ip(n k )) 

because of the slow variation of L, logL, and logx, and the fact that we have chosen our 
subsequence via the relation n k = ip(ck), which implies that ip(n k ) ~ ck. 
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Exploiting this yields 

f(n k + n k j L(n k )) = a nk+nk/L{nk) ■ d nk+rik / 

^ 1+ ^z^( 1 + Z(b)- l0 ^» ^ 

< . (1 + S) ■ log(y(n fc )) asfc^oo. 
L(n fc ) 

Next, for a slowly varying function L, let L# be its dc Bruijn conjugate (see, for example, 
[1], Section 1.5), obeying 

L{xL*(x))L*{x) -> 1 and L(x)L*(xL(x)) 1 as .t — > oo. (3.20) 

With its help, we can solve t = ££(£) asymptotically by £ ~ tL#(t). Now, for evaluating 
^4(fc,a;), we define 

= rm — / 7 \ \ and L 2 (u) = — —— — , 
L(u)log(ip(u)) L(u) 

both of which are slowly varying (in the case f(n) = n, we may define L 2 = 1), and their 
de Bruijn conjugates Lf(x) and L^(x). Then, with suitable constants Cj, we have 

C {fc:ciV>(cfe)Li(^(cA;)) < x 2 < c 2 iJj(ck)L 2 (ip(ck))} 

C {fc : c 3 x 2 Lf {x 2 ) < ip(ck) = n k < c±x 2 hf(x 2 )} 

C {k : c 5 (p(x 2 L*(x 2 )) <k< c^{x 2 L* (x 2 ))}. 

An application of the mean value theorem, the fact that <p'(x) = L(x)/x \ as x — > oo 
and (3.20) therefore imply that 

Card(A(fc, x)) < c^(x 2 L* {x 2 )) - c 5 tp{x 2 L* (x 2 )) < C(ip(x 2 L* (x 2 )) - <f{x 2 L# (x 2 ))) 
< Cv'{x 2 L*{x 2 )){x 2 L*{x 2 ) - x 2 L*{x 2 )) 

= C Hx ^l (x y (x 2 Lf(x 2 )-x 2 Lf(x 2 )) 



x 2 Lf(x 2 ) 

< c lo gM x 2 L*(x 2 ))) f Lf 
~ L 2 {x 2 L*{x 2 ))L*{x 2 ) 1 2 

<C\og(v(x 2 L*{x 2 )))L*(x 2 ). 
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Inserting this into the inner sum in (3.18), we now obtain 

1 <c _ L*(x^ 



V 7T^4< C tH^!LJ <CL#(x 2 ), (3.21) 

^) (1 ° gfc) (log^LfV))^ 



where the last inequality follows from the fact that 
using (3.20), 



(1o SV (x2L*(x2)))3 



< CLf(x 2 ) since, 



L*(x) L 2 (xLf(x)) 
L*{x) ~ L x {xL*{x)) 

< f(^f (*)) 



#/ 



" L(xL*(x)) 

<C(log(^(xif(x)))) 2 exp 



(log^^Lf^)))) 2 

xLf(x) 



xLf(x) 



e{t)/tdt 



<C(log(^(xif(x)))) 2 exp o(l) lo. 



L*(x) 



by the representation theorem for slowly varying functions. (In the case f(n) — n, the 
inequality (3.21) is trivial since Lf = 1 and L,f is decreasing.) Finally, using the fact 
that f- 1 {x)^ x L*(x), we conclude that the sum in (3.18) converges, which takes care 
of the second sum in (3.15). 

Combining this with (3.16) proves the validity of (3.14) in the symmetric case. 

Desymmetrization 

In order to prove (3.14) for the general case, we first estimate the truncated means. 
Remembering that EX k — for all k, we obtain, by stretching the bounds to the extreme, 



n-f a„ 



£ EX k I{b k <\X k \<5y/Tk} 



fe=n+l 
n-\-a n 



< J2 E\X k \I{b n <\X k \<S^f(n + n/L(n))} 

k=n+l 

< a n E\X\I{\X\ > b n } < ^EX 2 I{\X\ > b n } 



— -^-:y/a n d n EX 2 I{\X\ > b n } — o(a/ a n d n ) asn^oo 

(TO 

since this is the same estimate as for ET' n n+a , after which the desired conclusion follows 
with the aid of the symmetrization inequalities (see [5], Proposition 3.6.2). 
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3.5. Sufficiency along subsequences: T^' n+a 



In order for |T"' n+a J to surpass the level r\\J a n d n , it is necessary that at least one of the 
X //n s is non-zero. For every rj > (recall that a nk = nk/L(nk), d nk ~ logfc), this means 
that 

J2 P (\ T r'Ln k+ n k /L { n k )\ > vV^jZ) < E E P ( \ X "*+i I > \VJ^+J) 
k-1 k=lj = l ^ 

(3.22) 

<Y, a nuP[\X\>\yfJ{nk)) <oo, 
k=i \ ' 

by (3.16). 

3.6. Sufficiency along subsequences: Combining the contributions 

Combining (3.11), (3.14) and (3.22), we conclude that 

OO 

J2 P (\ T n k ,n k+ n k /L(n k )\ > (e + 2 V ) ^O^dQ) < OO (3.23) 
fe=l 

provided e > <j/(1 — <5) 3 / 2 and, since 77 and S may be arbitrarily chosen, that 

00 

,n k +n k /L(n k ) I > e \f^ a n k dn k ) < OO for £ > (7 (3.24) 

fe=l 

so that, in view of the first Borel-Cantelli lemma, 

hmsup = — 1 < cr a.s. (3.25) 

fc— >oo yJ1a nk d nk 

A completely analogous argument, combining (3.13), (3.14) and (3.22), yields 

OO 

^P{T nk ,n k +n k /L(n k ) > e^2a nk d nk ) = oo for e < a (3.26) 

k=l 

and since the windows with this, sparser, subsequence are disjoint, we may apply the 
second Borel-Cantelli lemma to conclude that 

1- Pn k ,n k +n k /L(n k ) to „n 

hmsup — > cr a.s. (3.27) 
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Finally, combining (3.25) and (3.27) yields 

hmsup — 7 \ — =a a.s., (3.28) 

fe->oo y'2a nk d nk 

which, in addition, proves the sufficiency of the following result, which is Theorem 2.1 for 
subsequences of the form n k = ip(ck) with c > 1. The necessity follows, of course, from 
the necessity for the full sequence, the proof of which is given in Section 3.8 below. 

Theorem 3.1. Suppose that X, X\,Xi,... are i.i.d. random variables with mean and 
finite variance a 2 , let T„ = Y]™— n+1 Xj and let, for c > 1, 

n k = V ( - 1) (ck), k>l, 
where ip^ 1 ^ is the inverse of tp(y) — j v ^^-du. If (2.1) holds, then 

hm sup = a a.s. (3.29) 

n^oo v /2(n fc /I/(n fc ))logfc 

Conversely, if 

r>( ' v \T nk +n k /L(n k ) I \ n /„ onx 

P hmsup ' v 4=<oo >0, (3.30) 

V n^oo ^[n k /Hn k ))\ogk J 

then (2.1) holds, EX = {), EX 2 < 00 and (3.29) holds with a 2 = VarX. 



3.7. Sufficiency for the entire sequence 

We must thus show that our process behaves accordingly for the entire sequence. Here, 
the second Levy inequality (see, for example, [5], Theorem 3.7.2) is instrumental. Let 
n > be given. Then, 

P ( max ■ g " + a " ~ S n > (1 + 6??)^ 

<P[ max (S n+an - S nk+a ) > 2r]o-^2a nk dn k ) 

\n k <n<n k + 1 k I 

(3.31) 

+ P[ max (-S n + S nk ) > 2r]o-y/2a„ k d nk ) 

\n k <n<n k + 1 I 

+ P[ max (S rik+an -S„ k )>(l + 2r])a^2a nk d nk ) , 

\n k <n<nk+i / 

where n k = ip(cn k ) as before with some suitable constant c > to be fixed shortly. 
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Set hk = rik + a Uk . Since rik+i/nk — > 1 and L(-) G <SV, the following relations hold 
eventually (that is, for k sufficiently large): 

n k+ i - n k < cifj'(c(k + 1)) = c < 2ca„ fc , 

n fe < n fc = n fe (l + (i(nfe))" 1 ) < n fc (l + 17), 
a„ k < a hk < a„ k{1+ri) < (1 + ??)a„ fc , 
- n fc < (n fc+ i - n fc )(l + < 2c(l + r7)a njt < 2c(l + rf)an. h , 

d, lk <dn k < (1 + T])d nk . 

In the following, we exploit these relations without specifically mentioning them each 
time. 

As a first application, we note that (3.31) can be bounded by 

<P[ max (S n -Sn k )> 2r\a^2a nk d nk J 

\h k <n<hk+2c(l+r})a flk / 

+ P( max {-S n + S nk ) > 2r)a^2a nk d nk ) (3.32) 

\n k <n<n k +2ca rlk / 

+ P( max (S nk +a ni -S nk )> (l + 2i])ay/2a nk d nk ). 

\n k <n<n k + 1 " / 

Now, 

Var(5 Sfc+2c (i+^) Qflfc - SWJ = 2c(l + r/)o flh CT 2 = o(a„ fc d„J as fc -> 00, 
Var(S , „ fc+2ca „ fc - S nk ) =2ca nk a 2 = o(a nk d nk ) as fc^oo, 
Var(S nfc+arife - 5„ h ) = arifcO- 2 = o(a„ fc d„J asfc^oo, 

that is, the variances are < rj i a 2 a nk d nk for k sufficiently large. 

An application of the Levy inequality to the first two probabilities in (3.32), leaving 
the third one as is, then shows that (3.32) can be bounded by 

< 2P((Sn k+ 2c(i+r,) afik ~Sn k )> 2i]a^2a nk d nk - a/2 • rfa ^ a nk d n J 
+ 2P(~(S nk+2c a„ k ~S nk )> 2i 1 a^2a nk d nk - \/2 ■ rfay/a nk d n J 
+ 2P((5 nfe+a „ fc - S nk ) > (1 + r))a^2a nk d nk ) 

< 2P((S , fu , +2c( i + ^) Qfifc - 5nJ > i](J^2a nk d nk ) 

+ 2P(-(S nk+2c (i+ n )a nk -S nk )> r\G^/2a nk d nk ) (3.33) 
+ 2P((5„ t+a „ fc - S nk ) > (l+rj)<j^2a nk d nk ) 
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< 2 ^(l^+2c(l +J? )a* fe -Sn k \> -y=!2== <J^2 ■ 2c(l + vj^A^J 

+ 2p(\S nk+ 2ca nh -S„ k \> -j!=,a«j2-2ca nk d nk j 

+ 2P(\S nk+ank - 5 n J > (1 + f])a^/2a nk d nk ). 

Summing the three probabilities over k and recalling (3.24) tells us that the total sum 
converges whenever 

mni — = , — =, 1 + 77 > > 1. 

\^2c(l + r]) 3 y/2e '/ 

Since we can choose c > arbitrarily small, we finally conclude that for any r\ > 0, we 
have 

£P( max Sn+ ;-- Sn >(l + 6r,)a]<oc, 

\n k <n<n k+1 yj Aa n a n J 

implying the upper inequality for the entire sequence, that is, 

T n , n+n/L{n) ^ 
hmsup - < rr a.s. 

n— >oo y2o, n d n 



3.8. Necessity 

By the zero-one law, the probability that the limsup is finite is or 1, hence, being 
positive, it equals 1. Consequently, (see [9], page 438), 

hm sup < oo a.s., 

n— >oo v ci n d n 

from which, in the CciS6 Q, n d n < f(n), it follows, via the second Borel-Cantelli lemma and 
the i.i.d. assumption, that 

J2 P(\X n \ > v^H) = J2 P(X 2 > /(n)), 

n— 1 n— 1 

which verifies (2.1). 

If (2.1) is weaker than finite variance, that is, if a n d n > f(n), then, by following Feller's 
proof [4] (see also, for example, [5], Section 8.4) of the necessity in the LIL with only 
obvious changes involving the replacing of sums by windows, we may conclude that (2.1) 
- that is, finite variance - also holds in this case. 

An application of the sufficiency part then tells us that (2.1) holds with a 1 = VarX. 

Finally, if EX — /i, then, by the law of large numbers, S n / f(n) ~ fin/ f(n) — > fi ■ oo as 
n — > oo, which forces fx to be equal to zero. 
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4.1. Proof of Corollary 2.1 

In this case, a n = n/(\ogn) p (for n > 9) so that 

TL 

dn = lo § ~~m ^ + lo S logn = (p + 1) log log n, 

ra/ (logn)P 

that is, /(n) = (p+l)r7,loglogn/(logn) p . It follows that / _1 («-) ~ (p "j'°gg^ gra as n ->• 
so that (2.1) turns out as 

^ <oo. 
log+log+|A| 

It remains to verify that xL' (x) / L(x) is decreasing. Now, L(x) = (logx) p and L'(x) 
x~ 1 p(\ogx) p ~ 1 so that xL'(x)/L(x) = p(\ogx)~ 1 , which indeed decreases. 



4.2. Proof of Corollary 2.2 

Thus, a n = n/log m (n) for n sufficiently large, so that 

d n = log log m (n) + log log n = log m+x (n) + log log n ~ log log n asn^oo. 

Since a n d n > n, we have f~ 1 (n) =nasm oo, which implies that finite variance is the 
appropriate necessary assumption. 

As for (1.2), this time, L(x) =\og m x and L'{x) =x~ 1 Y\™S 1 (logja;) -1 so that xL'(x)/ 
= niHi(l°gi a; ) _1 ! which indeed decreases. 



5. Further examples 

In this section we provide some additional examples to illustrate Theorem 2.1. As in 
Section 2 we omit stating converse results. 

The first example mixes powers of logarithms and iterated logarithms. 

Example 5.1. Let, for n > 9, a n = n(loglogn) 9 /(logn) p , p,q > 0, which means that 
the slowly varying function part is L(n) = (logn) p /(loglogri) <? . Differentiation and some 
algebraic simplification yield that xL' (x) / L(x) =p/\ogx — q/(logxlog 2 x), which is ulti- 
mately decreasing. Moreover, 

, / n,(loglogn) 9 \ , 
\ n/(iogn)P J 

= (p + 1) loglogn — q log log log n ~ (p + 1) loglogn as n— > oo 
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so that f(n) = (p + l)7i(loglog7i) 9+1 /(logn) p , which implies that / 1 (n) ~ Cn(\ogn) p / 
(loglogn) 9+1 as n-> oo. The following result emerges. 

Corollary 5.1. Suppose that X,Xi,X%, . . . are i.i.d. random variables with mean and 
finite variance a 2 , and let T n ^ n+ k = Y^j=n+i Xj ■ If, for some p,q> . 



. 2 (}og + \x\r 

(log+log+lXl)^ 1 



then 



.. ?n,n+n(loglogn)9/(logn)P ,_ 

hmsup — —a a.s. (5-2) 

n^oo V2(p+ l)(n/(logn)P)(loglogn)« +1 

The previous conclusion also holds, in fact, for q = 0, in which case Corollary 5.1 
reduces to Corollary 2.1 since the log log-contribution is of a lower order of magnitude. 
However, the case p = requires a separate treatment. 

Example 5.2. Let, for n > 9, a„ = n/(loglogn) 9 , g > 1. Now, L(x) = (\og 2 x) q gives 
xL'{x)/L{x) = g/(logxlog 2 x), which is decreasing. Moreover, 



d„ = log —rr — : — + log log n = q log log log n + log log n ~ log log n asn^oo, 

\n/(loglogn)V 

that is, f(n) ^ n(\og\ogn) 1 ~ q , and / (n) ~ ^(loglogTi) 9 ^ 1 as > oo. 

Corollary 5.2. Suppose that X,Xi,X%, . . . are i.i.d. random variables with mean and 
finite variance a 2 , and let T n , n+ k = Y^j=n+i ^0- ffi f or some q > 1, 

SZ^log+log+IX^-^cx), (5.3) 

i/ien 

.. 2n,n+n/(loglogn)9 /- ,s 

hmsup — — cr a.s. (5-4) 

n-yoo ^/27i(loglogn) 1_ 9 



Example 5.3. Let a n = 7i/exp{^/logn}, n > 1. Since L(x) = cxp{ ylog x} , we have 
xL'(x)/L(x) = (logx)^ 1 / 2 /2, which is decreasing. Moreover, 



d n = logexp{-\/logn} + log log n — y / \ogn + log log n ~ y^ogn as n^oo, 



which gives /(ti) ~ nylogn/ exp{v^ogn} as n — > oo so that 



/ 1 (n) ~ nexp{y / logn + l^}/Y / logn as7i— >oo. 
The following conclusion therefore holds. 



LIL and LSL 



19 



Corollary 5.3. Suppose that X, Xi, X2, ■ ■ ■ are i.i.d. random variables with mean and 

j—n+1 



finite variance a 2 , and let T n _ n+ k = X^=n+i Xj- If 



exp{J21og + |X|} 
EX 2 * <oo, (5.5) 

Ao K + \x\ 



then 

,. n,n+n/ exp{ Vlog ri} 

Inn sup = rr a.S. (5.6) 

n^oo ^2(n/exp{vTogn})\/Iogn 

The following example is a more general version. 

Example 5.4- Let, for n> 1, a n = ?i(logn) 7 /exp{(logn)^}, where < ft < 1 and 7 £ M. 
Thus, L(.t) = (log a;) -7 exp{(logx)"} and xL'(x)/L(x) = /3(loga:)' 9_1 — 7/logx, which is 
ultimately decreasing. Furthermore, 

d n = logcxp{(logn)^} — loglog((logn) 7 ) + loglogn ~ (logn)' 3 as n — >• 00, 

which gives 

/(n) ~ n(logn) ,3+7 / exp{(logn)^} as n — > 00. 
It follows that for < ft < 1/2, 

■L exp-^logn)' 3 } 

/ W~n— -g— asn^oo, 

(logn) p + 7 

for 1/2 < ft < 2/3, 

, expKlogn^+Klogz) 2 ^ 1 } 
/ (i 0gn) ^ +7 asr^oc, 

and so on. The following conclusion holds. 

Corollary 5.4. Suppose that X,Xi,X%, . . . are i.i.d. random variables with mean and 
finite variance a 2 , and let T n _ n+ k = X)J=n+i Xj . If < ft < 1/2 and 

. 2 exp{(21og+|X|n 



then 



EX 2 , L ,, 1 a <oo, (5.7) 
(log+|X|)^+ 7 



t -^n,n+nfloe;n)T / expKloe; n)' 3 } /_ 



^2n(logn) 7 +' 3 /exp{(logn)/ 3 } 
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6. A simplified Theorem 2.1 

As mentioned in the Introduction, this section concerns a weaker result, the proof of 
which is much easier, in that only one truncation is made. However, minimal moment 
conditions are not obtained. 



Theorem 6.1. Suppose that X, X\, X2, ■ ■ ■ are i.i.d. random variables with mean and 



finite variance a 1 , and let T n ^ n+ k = X]?— n 4. i Xj ■ Define sequences {a n } and {d n } 



as in 



Section 2 and set 



IfEX = Q and 



then 



Eb- 1 QX\)<oo, (6.1) 



Limsup = rr a.S. (o.2j 

n— >oo y2a n (i n 



6.1. Proof of Theorem 6.1 



Let 



X£ — X n I^\X n \ > —b n j — X„ — X' n . 



The contribution of T' n n , a 

This part requires no change. In other words, we first let {nk,k > 1}, where f~ oo as 
k — > oo, satisfy (3.10), and apply (3.4) to {X nk ,k > 1} to obtain 

oo 

E P (\ T L.n k+ a nk I > ey/ZOnM < OO 
k=l 

for the convergence part. 

After this, we choose a sparser subsequence {nk,k > 1}, where /*■ oo as k — > oo, 
satisfying (3.12) and apply (3.6) to obtain 

oo 

k .n k +a n ^ ^ \f^^nk ^n k ) — OO 

fc=l 

for the divergence part. 
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The contribution of T" n+a 

Since the X' n s have changed, we can use the stronger LSL argument here (see [6, 7]). 
Namely, in order for the \T^ n+a |'s to surpass the level r\\J a n d n infinitely often, it is 
necessary that infinitely many of the X' n s are non-zero. However, the latter event has 
zero probability in view of the first Borcl-Cantelli lemma since 

jrp(\x n \ > ^& n ) =f>(m > ^ bn ) < oo 

n— 1 ^ ' n— 1 ^ ' 

if and only if (6.1) holds. 

Completing the proof 

From this point on, the arguments are identical to those of the proof of Theorem 2.1. We 
therefore omit the details. 



6.2. Revisiting some examples 



Corollary 2.1 revisited for p — 1. With a n = n/logn and b n = y j"^^" , the con- 
clusion from Theorem 6. 1 is, as before. 



-^n,n+n/ log n 



= a a.s., 



•\/4(n /log n) log log n 
however, provided (6.1) holds, that is, provided 

£(X 2 log + |X|log + log+|X|)<oo, 
since b (n) ~ n 2 log n log log n. This should be compared with (2.4), 



EX 2 ~° '"' ■ < oo. 
log + log+|X| 

Corollary 2.2 revisited for m — 2. With m = 2, a n — n/ log log n and b n 



log+ \X\ 



\J "logfo'^ w^ ' ^he conclusion from Theorem 6. 1 is, as before, 



-^n,n-\-n I log log n 

= a a.s., 



tin 

however, provided (6.1) holds, that is, provided 

£X 2 (log + log+|X|) 2 <oo, 
which should be compared with the optimal one which was finite variance. 
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Corollary 5.1 revisited. Here, a n = n(\og\ogn) q / (\ogn) p , p,q>0. With 
b n = 



I n(loglogn)' /(\ogn)P / ?i(loglogn)9 _1 



log log n V (log n 

assumption (6.1) turns out as 



.2 (log + 



EX 1 \ I < oo, 

(log+log + |X|)9-i 



to be compared with the weaker 

(log+log+|X|)9+i 



(log + |A^ 

tlX -T -7—, < 00. 
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